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(54) An apparatus for a synchronized playback of audio-video signals 



(57) To provide an apparatus for a synchronized 
playback of compressed digital data of audio-video sig- 
nals with a sinrple configuration to be applied to a sys- 
tem having comparatively low data processing ability, 
independent of resolution of a software timer of the sys- 
tem, the apparatus of the invention comprises means 



(32 and 33) for obtaining a reference time indicating 
reproduction time passage of the audio signal compo- 
nent from reproduced data amount of the audio signal 
component, and means (31 and 34) for detecting 
progress of the video signal component in reference to 
the reference time. 



FIG. 1 
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Description 

The present invention relates to an apparatus for 
synchronized playback ot audio-video (hereafter abbre- 
viated as AV) signals, wherein compressed digital data 5 
of AV signals are decompressed into a video signal 
component and an audio signal component to be repre- 
sented in synchronization with each other. 

In the synchronized playback of AV signals, com- 
pressed digital data of AV signals read out from record- io 
ing media such as a CD-ROM (Compact Disk Read 
Only Memory) or a hard disk device are decompressed 
before being represented through output devices such 
as a CRT monitor and a speaker. When the apparatus 
for the synchronized playback is provided with data 
processing ability sufficiently high for the data decom- 
pression of the AV signals, or when video signal size of 
the compressed digital data is comparatively small, the 
data decompression of both of the video signal compo- 
nent and the audio signal component can be performed 
within a short time, and so. audio data and video frames 
can be reproduced without interruption. 

However, when the data processing ability of the 
apparatus is not sufficiently high compared to the video 
signal size of the compressed digital data, the appara- 
tus can not reproduce both the audio signal component 
and the video signal component in real time with which 
they are recorded originally, taking too much time for the 
data decompression processes. In consequence, the 
video signal component may be represented as a slow- 
motion film and the audio signal component is repro- 
duced intermittently. 

The intermittent reproduction of the audio signal 
component gives a sense of intense incongruity to the 
human hearing. Therefore, the audio signal component 
is usually processed to be reproduced continuously with 
a priority over the video signal component. The data 
decompression and displaying process of the video sig- 
nal component is performed when the audio signal com- 
ponent is not processed. Here, adequate thin down of 
the picture frames (so-called frame omission) becomes 
necessary for synchronizing the reproduction timings of 
the audio signal component arxJ the video signal com- 
ponent so that the video signal component may not be 
delayed from the audio signal component. 

As for the digital data compression, there is known 
an MPEG (Motion Picture Experts Group) standard, 
wherein the audio signal component and the video sig- 
nal component of the AV signals are multiplexed and 
compressed Into digital data each added with timing 
information indicating reproduction time of each thereof. 
By referring to the timing information, the audio signal 
component and the video signal component are repro- 
duced in synchronization in the decompression proce- 
dure. 

As a prior art technique of the synchronized play- 
back of the audio (voice) signal component and the 
video (picture) signal component, there is. for example. 



a Japanese patent application entitled "An apparatus for 
compression and reproduction of AV signals" and laid 
open as a Provisional Publication No. 107514/'95 (here- 
after called the first prior art apparatus). 

In the first prior art apparatus, color difference infor- 
mation is thinned down in a video data compression 
procedure considering the processing speed of the 
reproduction apparatus. Compensating the thinned 
down color difference information by simple interpola- 
tion, the decompression procedure of the video data is 
performed at a high speed, enabling synchronized 
reproduction of the video data and the audio data. 

In another Japanese patent application entitled 
"Variable speed synchronized playback of recorded dig- 
ital audio and video data" and laid open as a Provisional 
Publication No. 303240/'95 (hereafter called the second 
prior art apparatus), there is proposed another method 
of synchronized ptayt>ack with a variable speed of the 
audio signal component and the video signal compo- 
nent. 

In this method, a time required for decompression 
and playback of a frame of the video signal component, 
and a time required for decompression and reproduc- 
tion of a block of the audio signal component are calcu- 
lated from respective attribute irrformation of each 
thereof. One of the calculated times is used as a master 
time clock for decompession of the audio signal compo- 
nent and the video signal component. The audio signal 
component and the video signal component are decom- 
pressed more speedily or more slowly according to a 
scaling factor of the master time clock indicated by a 
user. 

A problem of the first prior art apparatus is that 
feedback control means for the synchronization are not 
provided. In the first prior art apparatus, the thinning 
down of the color difference information is performed a 
priori in the data compression procedure according to 
the information amount of the video signal component 
to be processed, and no means are provided for detect- 
ing lead or lag of a displayed video frame to the corre- 
sponding audio data. Therefore, unnecessary thinning 
down of color difference information is performed even 
when the playback apparatus is provided with sufficient 
data processing ability, and restoration of the lead or lag 
of the video signal component to the audio signal com- 
ponent can not be performed flexibly, in the first prior art 
apparatus. 

A problem of the second prior art apparatus is that 
a TDHS (Time Domain Harmonic Scaling) system is 
used for synchronizing reproduction of the audio signal 
component to the scaled master time clock. The TDHS 
system needs a little complicated processing inconven- 
ient to be applied to the playk>ack system with lew data 
processing ability, without saying of the distortion of the 
audio signal component. 

Furthermore, when the playback apparatus ^ 
implemented with software operating on an operating 
system with a low resolution software timer, there is a 
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problem that correct synchronization between the audio 
signal component and the video signal component can- 
not be obtained because of the low resolution of the 
software timer, even if the feedback control means are 
provided. That is, when the resolution of the software 
timer is 10ms and decompression process of the audio 
signal component corresponding to one frame of the 
video signal component having 30 frames per second 
takes 1 3ms, for example, decompression process of the 
audio signal component is measured to be accom- 
plished in 10ms, and 23ms is allotted for decompression 
process of the video signal component of one frame. 
Therefore, a delay of 3ms par frame is derived in the 
reproduction of the video signal component. 

This is another problem of the prior art apparatus. 

Therefore, a primary object of the present invention 
is to provide an apparatus for a synchronized playback 
of audio-video signals with a sinple configuration to be 
applied to a system having comparatively low data 
processing ability such as a personal computer, wherein 
the video signal component can be decompressed and 
reproduced in synchronization with the aLxdio signal 
component adequately from the compressed digital 
data according to the data processing ability of the sys- 
tem, independent of resolution of the software timer of 
the system. 

In order to achieve the object, an apparatus for syn- 
chronized playback of audio-video signals of the inven- 
tion, for representing an audio signal component and a 
video signal component in synchronization with each 
other by decompressing compressed digital data of the 
audio signal component and the video signal compo- 
nent, comprises; 

means for obtaining a reference time indicating 
reproduction time passage of the audio signal com- 
ponent from reproduced data amount of the audio 
signal component. 

a video frame counter for counting and maintaining 
a real frame number of the video signal component 
which indicates a sum of a frame number actually 
decompressed and a frame number omitted to be 
decompressed, 

a delay detector for calculating an ideal frame 
number of the video signal component to be dis- 
played originally from the reference time, and 
detecting progress of the video signal component 
by comparing the real frame number to the ideal 
frame number, and 

means for restoring difference of display timing of 
the video signal component from the reference time 
by performing frame omission and decompression 
waiting of the video signal component according to 
the progress of the video signal component. 

Therefore, the video signal component can be 
decompressed and reproduced in synchronization with 
the audio signal component adequately from the com- 



pressed digital data with a simple configuration accord- 
ing to the data processing ability of a system wherein 
the apparatus of the invention is applied, independent of 
resolution of the software timer of the system, without 

5 needing any special hardware timer. 

The foregoing, further objects, features, and advan- 
tages of this invention will become apparent from a con- 
sideration of the following description, the appended 
claims, and the accompanying drawings wherein the 

10 same numerals indicate the same or the corresponding 
parts. 

In the drawings: 

FIG. 1 is a block diagram illustrating a fundamental 
75 configuration of an apparatus for a synchronized 
playback of audio-video signals according to an 
embodiment of the invention; 
FIG. 2 is a schematic diagram illustrating an exam- 
ple of data stream of the video signal component 
20 subjected to frame omission; 

FIG. 3 is a schematic diagram illustrating the PCM 
buffer 23 of FIG. 1 for storing the data of the audio 
signal component to be reproduced; 
FIG. 4 is a flowchart illustrating main processes of 
25 the embodiment of FIG. 1 ; 

FIG. 5 is a flowchart illustrating details of the audio 
processing performed by an interruption at step A3 
of FIG. 4; and 

FIG. 6 is a ftowchart illustrating details of the video 
30 processing performed at step A4 of FIG. 4. 

Now, embodiments of the present invention will be 
described in connection with the drawings. 

FIG. 1 is a block diagram illustrating a fundamental 
35 configuration of an apparatus for a synchronized play- 
back of AV signals according to an embodiment of the 
invention. 

Refemng to FIG. 1 , the apparatus comprises; 
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a data recording device 1 for storing compressed 
digital data of AV signals, 

an AV separation unit 2 for extracting an audio sig- 
nal component and a video signal component mul- 
tiplexed in the compressed digital data read out of 
the data recording device 1 , 
a video signal processor 3 for performing decom- 
pression of the video signal component extracted 
by the AV separation unit 2, 
an audio signal processor 4 for performing decom- 
pression of the audio signal component extracted 
by the AV separation unit 2, 
an AV synchronization controller 5 for performing 
synchronization control between the audio signal 
component and the video signal conponent, 
a CRT monitor 6 for displaying the video signal 
component, and 

a speaker 7 for reproducing the audio signal com- 
ponent. 
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The video signal processor 3 includes; 

a compressed video data buffer 11 for storing com- 
pressed data of the video signal component 
extracted by the AV separation unit 2. 
a video decoder 12 for deconpresslng the com- 
pressed data of the video signal component buff- 
ered in the compressed video data buffer 11 by 
analyzing attribute information (video header infor- 
mation) thereof, 

a frame buffer 13 for buffering frame data of the 
video signal component decompressed by the 
video decoder 12, and 

a video display controller 14 for generating display 
signals to be supplied to the CRT monitor 6 by read- 
ing out the frame data prepared in the frame buffer 
13 in synchronization with synchronous signals for 
the CRT monitor 6. 

The audio signal processor 4 includes; 

a compressed audio data buffer 21 for storing com- 
pressed data of the audio signal component 
extracted by the AV separation unit 2, 
an audio decoder 22 for decompressing the com- 
pressed data of the audio signal component buff- 
ered in the compressed audio data buffer 21 by 
analyzing attribute information (audio header infor- 
mation) thereof, 

a PCM buffer 23 for storing data of the audio signal 
component decompressed by the audio decoder 
22, and 

an audio reproduction controller 24 for generating 
sound signals to be supplied to the speaker 7 
according to the data of the audio signal component 
supplied from the PCM buffer 23. 

The AV synchronization controller 5 includes; 

a video frame counter 31 for counting and maintain- 
ing a real frame number of the video signal compo- 
nent which indicates a sum of a frame number 
actually decompressed and a frame number omit- 
ted to be decompressed by the video decoder 12, 
from the beginning of reproduction, 
an audio data counter 32 for counting and maintain- 
ing data amount of the audio signal component 
actually decompressed and reproduced by the 
audio reproduction controller 24 from the beginning 
of reproduction according to reproduction informa- 
tion supplied from the audio reproduction controller 
24. 

a clock generator 33 for calculating a reference time 
indicating reproduction time passage of the audio 
signal component from the data amount counted by 
the audio data counter 32 referring to the audio 
header information analyzed by the audio decoder 
22, 



a delay detector 34 for calculating an ideal frame 
number of the video signal component to be dis- 
played originally from the reference time calculated 
by the clock generator 33 referring to the video 

5 header information analyzed by the video decoder 

12, and detecting lead or lag of the video signal 
component to the audio signal component by com- 
paring the ideal frame number and the real frame 
number counted by the video frame counter 31 , and 

10 a frame omission controller 35 for performing the 
frame omission when the video signal component is 
delayed from the audio signal component according 
to the lead or lag detected by the delay detector 34 
referring to priority of frames to be decompressed. 

15 

In other words, the video frame counter 31 of the AV 
synchronization controller 5 operates as means for 
counting the real frame number of the video signal com- 
ponent actually processed (decompressed or omitted), 

20 and the audio data counter 32 and the clock generator 
33 operate as means for obtaining the reference time 
indicating reproduction time passage of the audio signal 
component, as will be described afterwards. irxJepend- 
ent of a software timer of the system which may not 

25 available for correct synchronization because of its 
insufficient resolution. 

Further, the delay detector 34 operates as means 
for calculating the ideal frame number of the video sig- 
nal component to be decompressed and displayed orig- 

30 inally in an interval indicated by the reference time, as 
well as operating as means for detecting progress of the 
video signal component in reference to the reference 
time, that is. detecting the lead or lag of the video signal 
component to the audio signal component by compar- 

35 ing the ideal frame number and the real frame number. 
And the frame omission controller 35 operates as 
means for restoring the lead or lag of display timing of 
the video signal component to reproduction timing of the 
audio signal component by indicating the frame omis- 

40 sion or decompression waiting of the video signal com- 
ponent to the video decoder 12, according to the 
progress of the video signal component detected by the 
delay detector 34. 

Here, the frame omission is performed according to 

45 the order of priority of frames as will be described in the 
following paragraphs, and the decompression waiting is 
performed when a lead of the video signal component is 
detected by the delay detector 34 until the audio signal 
component overtakes the video signal component. 

50 Now, the order of priority of frames Is described. 

FIG. 2 is a schematic diagram illustrating an exam- 
ple of data stream of the video signal conrponent sub- 
jected to the frame omission performed by the frame 
omission controller 35. In the example, frame data of the 

55 video signal component are ranged according to an 
^nter-frame prediction coding system such as the MPEG 
standard, for example. 

Referring to FIG. 2, the data of the video signal 
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component has a frame composition comprising a plu- 
rality of GOP (Group Of Pictures) data, each including 
data of I (Intra), P (Predictive) and B (Bidirectionally pre- 
dictive) pictures. The l-picture, coded from intra-frame 
data, can be decompressed independently from itself 5 
without any key frame, and is used as a key frame to be 
referred to when following frames are decompressed. 
The P-picture, coded according to forward prediction, is 
decompressed referring to a preceding key frame. The 
P-picture is also used as a key frame to be referred to w 
when following and preceding frames are decom- 
pressed. The B-picture, coded according to bi-direc- 
tional prediction, is decompressed referring to a 
preceding key frame and a following key frame, being 
referred to by no other frame. 75 

The key frame is a picture to be referred to when 
other pictures are decompressed, and so, when a key 
frame is omitted to be decompressed, following P and 
B'pictures until a next l-picture appears should be also 
omitted, unable to be decompressed. 20 

Therefore, the frame omission priority is attributed 
to the B-picture, the P-piclure and the l-picture. in the 
order. 

Now. the PCM buffer 23 for storing the data of the 
audio signal component to be reproduced is described 2$ 
referring to a schematic diagram of FIG. 3. 

The PCM buffer 23 operates as a ring buffer com- 
prising a plurality of memory blocks (1) to (n), wherein 
the data of the audio signal component decompressed 
by the audio decoder 22 are stored to be read out and 30 
supplied to the audio reproduction controller 24 in turns 
cyclically to be reproduced. 

When reproduction by the audio reproduction con- 
troller 24 of data read out and transferred from a mem- 
ory block of the PCM buffer 23 is accomplished, an 35 
interruption is occurred and data in next memory block 
Is transferred to the audio reproduction controller 24 to 
be reproduced. The audio decoder 22 decompresses 
the audio signal component to be stored in the next 
memory block which is read out, interrupting processing 40 
of the video signal component even when the video sig- 
nal conrponent is under processing. For example, when 
reproduction of data of the memory block (1 ) of FIG. 3 is 
accomplished, data of the memory block (2) is read out, 
transferred to the audio reproduction controller 24 and 45 
begins to be reproduced. In the memory block (1), data 
of the audio signal component newly decompressed by 
the audio decoder 22 is stored to be read out after 
reproduction of data of the memory block (n) is accom- 
plished, so 

Thus, the audio signal component is decompressed 
with the interruption processing prior to other procedure 
such as the decompression process of the video signal 
component, in the embodiment. Therefore, the audio 
signal component can be reproduced without interup- ss 
tion, and accordingly, a precise reproduction time can 
be obtained from reproduction progress of the audio 
signal component at the audio reproduction controller 
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24. 

Now, operation of the synchronized playback of AV 
signals in the embodiment of FIG. 1 is described refer- 
ring to flowcharts of FIGs. 4 to 6. 

FIG. 4 is a flowchart illustrating main processes of 
the embodiment. 

As initializing procedure, data read-out (at step A1) 
and audio data decompression (at step A2) are per- 
formed at the beginning of reproduction of AV signals. 

At step A1 , a block of multiplexed digital data of 
conpressed AV signals is read out from the data 
recording device 1, and separated into compressed 
data of the video signal component and those of the 
audio signal component, which are stored in the com- 
pressed video data buffer 1 1 and the compressed audio 
data buffer 21, respectively. Then, at step A2, the video 
frame counter 31 and the audio data counter 32 are 
reset, and audio data decompression is executed, 
wherein compressed data of the audio signal compo- 
nent to be prepared in all the memory blocks of the PCM 
buffer 23 are read out from the compressed audio data 
buffer 21 and decompressed referring to the audio 
header information therein. 

After the initialization procedure, audio processing 
(at step A3) and the video processing (at step A4) are 
repeated until it is detected (at step A5) that there is left 
no compressed data to be processed in the com- 
pressed video data buffer 11. Here, in FIG. 4, the audio 
processing of step A3 and the video processing at step 
A4 are depicted to be performed sequentially However, 
in the embodiment, the audio processing at step A3 is 
performed whenever an interruption occurs for the 
audio data processing, as beforehand desaibed, Inter- 
rupting the video processing at step A4 even when it is 
under execution at the time. 

FIG. 5 is a f towchart illustrating details of the audio 
processing performed by an interruption at step A3 of 
FIG. 4. 

When there is no data in the audio reproduction 
controller 24, an inten^uption is occurred and data of a 
first/next memory block in the PCM buffer 23 are read 
out and transferred to the audio reproduction controller 
24 (at step B1), which are converted into analog signals 
to be supplied to the speaker 7 according to a sampling 
frequency indicated by the audio header information. 
Then (at step B5), the compressed data of the audio 
signal component are read out from the conpressed 
audio data buffer 21, decompressed by the audio 
decoder 22 and stored in the first/next memory block 
which is read out, on condition that there are com- 
pressed data left to be processed in the compressed 
audio data buffer 21. Then, the audio processing 
returns, waiting a next interruption. When it is detected 
(at step B2) that there is no compressed data to be 
processed in the compressed audio data buffer 21 , the 
data read-out at step B4 is performed in the same way 
with step A1 described in connection with the initializa- 
tion procedure of FIG. 4, on condition it is detected (at 
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step B3) that there are compressed digital data of AV 
signals left to be reproduced in the data recording 
device 1 . When there is detected no compressed digital 
data of AV signals left to be reproduced in the data 
recording device 1 , only the data read-out and transfer 5 
at step B1 is performed for each interruption until data of 
all the memory blocks in the PCM buffer 23 are trans- 
ferred to the audio reproduction controller 24. 

Thus, the audio signal component is reproduced 
without interruption, in the embodiment. 

Now, details of the video processing at step A4 of 
FIG. 4 is described referring to the flowchart of FIG. 6, 
wherein the synchronization control and decompression 
of the video signal component are performed. 

Rrst (at step CI ), the data amount of the audio sig- 
nal component actually decompressed and reproduced 
by the audio reproduction controller 24 from the begin- 
ning of reproduction is acquired from the audio data 
counter 32. Then (at step C2). the referer»ce time indi- 
cating the reproduction time passage of the audio signal 
component is calculated by the clock generator 33 from 
the data amount referring to the audio header informa- 
tion obtained at step A2 of FIG. 4, as follows. 

When the audio header information indicates 
audio data of Layer t, bit rate of 192,000 bits/sec, sam- 
pling frequency of 44.1 KHz and 2-channel stereo sig- 
nal, for example. 2 channels of analog signals are 
generated by the audio reproduction controller 24 from 
2 X 16btts X 441. 000/sec of the decompressed data 
supplied from the PCM buffer 23. Therefore, when the 
data amount of D bytes is acquired from the audio coun- 
ter 32, the reference time T is calculated as 
r(sec) = D X 8/(44, 100 X 2 X 16) . 

Thus, the reference time T is calculated according 
to the data amount D counted by the audio data counter 
32 from the reproduction information supplied from the 
audio reproduction controller 24, independent of the 
software timer of the system without needing any spe- 
cial hardware timer, in the embodiment. 

By multiplying the reference time 7 by frame rate of 
30 frames/sec, for example, indicated by the video 
header information, the ideal frame number Fl = 30 r is 
obtained, which is compared to the real frame number 
FR (at step C3) by calculating progress PR = FR - Fl of 
the video signal component. 

When the progress PR = 0. the video signal compo- 
nent is synchronized to the audio signal component, 
while it is leading when the progress PR is positive and 
lagged when the progress PR is negative. However, 
when the decompression waiting or the frame omission 
is performed directly according to positive/negative of 
the progress PR, the control becomes unstable. There- 
fore, a threshold range is preferably provided for the 
synchronization discrimination. In the embodiment 
when -4 < the progress PR < 1 . the video signal connpo- 
nent is disaiminated to be synchronized to the audio 
signal component (at step C4), considering the fact that 
the lead of the video signal component gives a sense of 



more incongruity than the lag thereof. 

Returning to FIG. 6, when the ideal frame number 
Fl is 10 and the real frame number FR is 11. for exam- 
ple, the video signal component is discriminated to be 
leading the audio signal component, the progress PR 
being one, and control of the video processing returns 
directly from step C4. The video processing of step A4 
of FIG. 4, that is, steps CI to C4 of FIG. 6 are repeated 
(including the audio processing of step A3, when there 
is an interruption) until the progress PR becomes less 
than one, the ideal frame number becoming more than 
1 1, in the example. Thus, the decompression waiting is 
performed in the embodiment. 

When the ideal frame number Fl is 10 and the real 
frame number is 8, for example, the video signal compo- 
nent is discriminated to be synchronized with the audio 
signal component, the progress PR being -2. In the 
case, the control goes to step C5 from step C4. Com- 
pressed data of a frame are read out from the com- 
pressed video data buffer 11, decompressed by the 
video decoder 12 and stored in the frame buffer 13 (at 
step C6) to be displayed on the CRT monitor 6 by the 
video display controller 14. Then (at step C7), the real 
frame number FR is added with one, and the control 
returns. 

When the ideal frame number Fl is 10 and the real 
frame number is 5. for example, the video signal compo- 
nent is discriminated to be lagged from the audio signal 
component, the progress PR being -5. In this case, the 
control goes to step C8, where the omission priority of 
the concerning frame is checked. In the embodiment, 
the frame omission is set not to be performed for the I 
and the P-picture, the control going to step C5 in the 
case for performing the decompression of the concern- 
ing frame. If it is the B-picture, the control goes to step 
C9 for rejecting data of the concerning frame from the 
compressed data buffer 1 1 , and the real frame number 
is added with one at step CI 0 in the same way with step 
C7. 

Thus, the synchronized play back of the AV signals 
is performed in the embodiment. 

Here, the frame omission is described to be per- 
formed only for B-pictures. However, the frame omission 
may be set to be performed for the P or l-frames too, by 
providing a second and a third threshold value accord- 
ing to the omission priority, for example, when the 
progress PR is lower than the second and the third 
threshold value. In the case, data of the compressed 
video data buffer 1 1 are to be rejected until data of next 
l-frame at step C9 and the real frame number FR is to 
be added at step CIO with a number of frames rejected 
at step C9. 

As heretofore described, the synchronization con- 
trol of the AV signals is performed according to the data 
amount D counted by the audio data counter 32 from 
the reproduction information supplied from tiie audio 
reproduction controller 24 in the embodiment, and so, 
the video signal component can be decompressed and 
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reproduced in synchronization with the audio signal 
component adequately from the compressed digital 
data with a simple configuration, independent of resolu- 
tion of the software timer of a system wherein the appa- 
ratus of the embodiment is applied, without needing any 
special hardware timer. 

The audio signal component is processed with a 
priority to be reproduced without any interruption, and 
even when the frame omission is necessary, it is per- 
formed according to priority of frames, enabling a 
smooth presentation of the video signal component, 
and eliminating unnecessary frame omission according 
to the data processing ability of the system. 

Claims 



4. The apparatus for synchronized playback of audio- 
video signals recited in daim 3; wherein said frame 
omission is performed according to an order of pri- 
ority attributed to frames of the video signal compo- 

5 nent subject to said frame omission in connection 
with kinds of compressed data of said frames. 

5. The apparatus for synchronized playback of audio- 
video signals recited in claim 3; wherein said 

10 decompression waiting is performed by controlling 
decompression of compressed data of a frame of 
the video signal component to wait until said differ- 
ence of display timing of said frame from said refer- 
ence time becomes within a threshold value. 



1 . An apparatus for synchronized playback of audio- 
video signals for representing an audio signal com- 
ponent and a video signal component in synchroni- 
zation with each other by decompressing 20 
compressed digital data of the audio signal compo- 
nent and the video signal component, said appara- 
tus comprising: 



means (32 and 33) for obtaining a reference 25 
time indicating reproduction time passage of 
the audio signal component from reproduced 
data amount of the audio signal component; 
and 

means (31 and 34) for detecting progress of 30 
the video signal component in reference to said 
reference time. 



2. The apparatus for synchronized playback of audio- 
video signals recited in claim 1 , said means (31 and 35 
34) for detecting progress of the video signal com- 
ponent having: 



a video frame counter (31) for counting and 
maintaining a real frame number of the video 40 
signal component which indicates a sum of a 
frame number actually decompressed and a 
frame number omitted to be decompressed; 
and 

a delay detector (34) for calculating an ideal 45 
frame number of the video signal component to 
be displayed originally from said reference 
time, and detecting said progress of the video 
signal component by comparing said real 
frame number to said ideal frame number. so 



3. The apparatus for synchronized playback of audio- 
video signals recited in claim 1 , further comprising 
means (35) for restoring difference of display timing 
of the video signal component from said reference ss 
time by performing frame omission and decompres- 
sion waiting of the video signal component accord- 
ing to said progress of the video signal component. 
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